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Abstract. It is an important open problem whether the dimension of 
the Nichols algebra 23(0, p) is finite when is the class of the trans- 
positions and p is the sign representation, with m > 6. In the present 
paper, we discard most of the other conjugacy classes showing that very 
few pairs (0, p) might give rise to finite-dimensional Nichols algebras. 



1. Introduction and Main Result 



1.1. The context. This paper contributes to the classification of finite- 
dimensional pointed complex Hopf algebras H whose group of group-likes 

pg \ G(H) is isomorphic to S m . Suppose we want to classify finite-dimensional 

£> | pointed Hopf algebras with a fixed G(H) = G. As explained in [AS] , the 

^•^ ■ crucial step is to determine when the Nichols algebra of a Yetter-Drinfeld 

,_i- \ module over G is finite-dimensional or not. Recall that irreducible Yetter- 

(SJ ■ Drinfeld modules over G are determined by a conjugacy class O of G and 

j^ . an irreducible representation of the centralizer G a of a fixed a G O. Let 

<^ | M(0,p) be the corresponding Yetter-Drinfeld module and let 93(0, p) de- 

25 ■ note its Nichols algebra. 

O ■ 

1.2. Statement of the main result. Assume that G = S m , 3 < m G 
K> \ N. We fix a G S m of type (l ni ,2 n2 , . . . ,m" m ), which means that in the 

$_i ■ decomposition of a as product of disjoint cycles appear rij cycles of length 

j, for every j, 1 < j < m. We will write 

(1) a = A 1 ---A m , 

where Aj = A\j • • • A nj j is the product of the rij > disjoint j-cycles A\j, 
. . . , A n .j of a. We omit Aj when rij = 0. The even and the odd parts of a 
are 

(2) cr e := Yl A J, Vo ■= IJ Aj. 

j even l<j odd 
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2 ANDRUSKIEWITSCH, FANTINO AND ZHANG 

Thus, g = A\o e a . By abuse of notation we shall say that a has type 
(l ni , 2 n2 , . . . , cr ) to mean that the type of the a entering in a is arbitrary. 
Here is our main Theorem. See below for unexplained notation; in particu- 
lar, see ([5]) for the meaning of pj. 

Theorem 1. Let a £ S m be of type (l ni ,2 n2 , . . . ,m Um ), let O be the con- 
jugacy class of a and let p = (p,V) £ S^. Assume that dim 25(0, p) < oo. 
Then q aa = — 1 and some of the following hold: 
(i) (l ni ,2), p 1 = sgn or e, p 2 = sgn. 

(ii) (2, a ), a / id, p 2 = sgn, pj = Indx(o,..,o) ® Pj, for all j > 1 odd. 
(hi) (l ni ,2 3 ), pi = sgn or e, p 2 = X(3) ® e or X(3) ® sgn. 

Furthermore, if n\ > 0, i/ien p2 = X(3) ® s § n - 
(iv) (2 5 ), p 2 = X(5) <2> e o?" X(5) 8) sgn. 
(v) (l ni ,4), pi = sgn or e, p 4 = X(-l)- 

(vi) (l ni ,4 2 ), pi = sgn or e, p 4 = X(i,i) <8) sgn or X(-i-i) ® sgn. 
(vii) (2, 4), p = sgn ®e or p = e <g> X(-i) • 
(viii) (2,4 2 ), p 2 = e, p 4 = X(i,i) ® sgn or X(-i-i) ® sgn. 
(ix) (2 2 ,4), degp 2 = 1, p 4 = X(-i)- 

We stress that in most of the cases en the previous statement, whether the 
dimension of the corresponding Nichols algebra is finite is an open problem; 
the point of the Theorem is to discard the cases not comprised in (i) to (ix). 

1.3. Proof of the main result. In the previous papers [AFllKZ] and in 
a preliminar version of the present paper, the idea was to look at abelian 
subracks. But we have found that the techniques based on non-abelian 
subracks presented in |AF2j - consequences of the results in jAHSj - conduct 
faster to a more complete analysis of Nichols algebras over symmetric groups. 
We use also here another technique, an extension of [Gnlj . consisting in 
finding a suitable braided vector subspace of diagonal type not supported 
by an abelian subrack but "transversal" - see Proposition 13.31 We now 
outline the proof of the main Theorem, addressing to previous papers or to 
results in the present paper for proofs of the different steps. 

Proof. We state the different arguments that reduce the class of possible 
Nichols algebras with finite dimension. 

(a) q aa = — 1 and a has even order by [AZl 2.2], cf. Lemma 12. II below. 

(b) If j > 6 is even, then nj = 0; this follows from [AF21 Ex. 2.10] for j 
having an odd divisor, and from Proposition 13.31 for j a power of 2. 
Hence degpi = 1 by Propositions 13.81 and 13.91 that is, p\ = sgn or e. 

(c) n 4 < 2, by [A"F2l Ex. 3.10]; n 2 < 5, by [A"F2l Ex. 3.13]. 

(d) degp2 = degp 4 = 1, by Proposition 3.4 and [AZL Prop. 2.6]. 
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(e) Assume that there exists j > 3 such that rij > 0. Then 712 < 2 by 
[A"F2l Ex. 3.12]. If n 2 > 0, then ni = by [AT2| Ex. 3.9]. Moreover, 
(2 2 ,4 2 , a ) is excluded by Proposition 13.61 

(f) If tt-4 > 0, then a is trivial by Prop. 13.71 The restrictions on the 
representations follow from Proposition 13.51 

(g) Assume next that for any j > 3, n,j = 0, so that a is of type 
(l ni ,2™ 2 ). Then n 2 + 2 by [Ml Th. 2.7] and n 2 + 4 by (AFTl Th. 
1 (B) (i)] together with [AZ} Prop. 2.6]. Also, p 2 should be X(n 2 ) ® e 
or X(n 2 ) ® sgn by [AFlj Th. 1 (B) (ii)]. Now, by Lemma [3. 101 we 
have the restrictions on the characters in (hi) and (iv) . On the other 
hand, the claim in (ii) for the representations pj, j > 1 odd, follows 
from Lemma |3. 11 □ 

1.4. Comments on the cases left open. Let us say that M(0,p) has 
negative braiding if the Nichols algebra of any braided subspace correspond- 
ing to an abelian subrack is (twist-equivalent to) an exterior algebra. 

(I) In the cases (i)-(ix) of the main Theorem, there is no family of type 
£)( 2 ) nor j)p , for any odd prime p, inside the respective conjugacy 

(2) 

classes. Besides, there is no transversal subrack of type T>\ . More- 
over, it is easy to see that the corresponding braiding is negative in 
all cases. 
(II) We know that dim 25(0, p) < oo in the following cases: is the 
class of the transpositions, p = id <8) sgn or e sgn (see the notation 
below) and m < 5 (MSI EH EH]; or O is the class of the 4-cycles, 
p = X(-i) an d m = 4 [AG! Th. 6.12]. It is an important open 
problem whether the dimension of 25(0, p) is finite when O is the 
class of the transpositions and m > 6. 
(Ill) The Yetter-Drinfeld modules over the group algebra CG, with G 
a finite group, are semisimple. The Nichols algebra of a finite- 
dimensional reducible Yetter-Drinfeld module over S m is always in- 
finite-dimensional - see [HSj . see also [AHSl Section 4]. 

2. Preliminaries 

2.1. Generalities. We follow the conventions in [AZllAFi] . We denote by 
G the set of isomorphism classes of irreducible representations of a finite 
group G. We use the rack notation x > y := xyx^ 1 . We set to n := e~ , 
where i = y/— 1. 

Let a G G, O a the conjugacy class of a and p = (p,V) £ G° '. Since 
a £ Z(G a ), the center of G a , the Schur Lemma implies that 

(3) a acts by a scalar q aa on V. 

Lemma 2.1. jAZL Lemma 2.2] Assume that a is real (i. e. o~~ l £ CT j. If 
dim OS (0 CT , p) < oo, i/ien g CT(T = —1 and s has even order. □ 
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The following result follows from |H] . 

Lemma 2.2. Let W be a braided vector space, U C W a braided vector 
subspace of diagonal type, Q the generalized Dynkin diagram corresponding 
to U. If Q contains a t-cycle with t > 3, then dimQ3(M /r ) = oo. □ 

2.2. Symmetric groups. Let a G S m be of type (l ni ,2 n2 , . . . ,m nm ). Re- 
call the notation ([I]). The centralizer of a is isomorphic to a product 
S* = 2i x ■ ■ ■ x T m , where 

(4) Tj = (A ltj , ..., A n , d ) x (B ltj , ..., B^.-ij) ~ (Z/j)^ x S„„ 

1 < j < m. We will choose Ai, . . . , A m such that A\ t \ = (1), . . . , A ni> i = 
(m), Ai y2 = (ni + 1 ni + 2),. . . , A n2y2 = (jn + 2n 2 — 1 n\ + 2n 2 ), and so 
on. More precisely, if 1 < j < m and r := Yli<k<j-i ^ n &> then 



A l,j : = ( r + ( l ~ l )J + 1 r + (l-l)j + 2 r + lj 

B h j :=(r + (h-l)j + l r + hj + 1 ) ( r + (h - 1) j + 2 r + /ij + 2 ] 
■ ■ ■ (r + hj r + (h+ l)j 
for all I, h, with 1 < I < rij, 1 < h < rij — 1. Notice that Bhj is an involution. 

Let p = (p, V) G §^; so 

p = Pl (g> ... ®p m , 

where /?.,■ G Tj has the form 

( 5 ) pj = lnd I ™j > . s xAxj®Vj), 

j n j 

with Xj ^ ^? an d Aij G §>n] - see [S] Section 8.2]. Here S*] denotes the 

isotropy subgroup of Xj under the induced action of S nj over Z - 3 . Actually, 
Xj is of the form X(t x -,...,t n . ■)' wnere < tij, . . . ,t nj j < j — 1 are such that 

(6) X( tl ,,,..., S ,,)(A J -)=^ ) l<l<n r 
Notice that if pj is as in ([5]) , then 

(7) de S Pj = [S nj :S^ i) ]degn J . 

Remark 2.3. Since every Aj belongs to Z(S^), Aj acts by a scalar g^, on 
V. Thus, 

Qaa = q e Qo, where q e = [ g^ and <? = q^.. 

j even l<j odd 
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Remark 2.4. Assume that deg(p) = 1; that is, deg(pj) = 1, for all j. Then 

(8) Snj = S nj and fj,j = e or sgn G § n ., for all j, 

by (J7|). Hence, we have that t,- := tij = ■■■ = t nj j, for every j, and 
pj = Xj ® A*j- I n that case, we will denote Xj — X(t ,...,* •) by Xu- Thus, for 
every j there exists tj, with < tj < j — 1, such that 

(9) P=(x£®A*i)® ,,, ®(xC®A«m)- 

If rej = or 1, then /3j is just the trivial representation. We will denote 

(10) t :=(ti,..., t m ), 

which is a m-tuple that depends on p. Any one-dimensional representation 
of S^ is completely determined by (/ii, . . . , /i ra ) and t as above. 

3. New restrictions on orbits and characters 

Our first new result restricts the possibilities for the exponents t_ : _'s of 
the representation p. The proof is an application of the technique of abelian 
subracks. 

Lemma 3.1. Let p = (p, V) £ S^. If there exist j, I, with 1 < j < m and 

1 < I < rij, such that ui- l ' j ^ 1, then dim 93(0<j, p) = oo. 

Proof. Notice that j ^ 1, 2. Let N = Ylj>3 n j- We consider two cases. 

(a) Assume that N = 1. In this case, the type of a is (l ni ,2 n2 ,j). Then 
Pj = Xtji for some tj, < tj < j — 1, and (/ CTCr = ±u> J 7^ ±1, by hypothesis. 
Now the result follows from Lemma l2.1i 

(b) Assume that N > 1. By Lemma |2. 11 we may suppose that q aa = — 1. 
There exists t> G V — such that p(Aij)v = oj-' j v. We define a\ := a, 

02 := o~ Aj. , (T3 := <7^~ and 04 := a" 1 ; clearly, these are four different 
elements. Let t = (ii %2" ' ij) be a j-cycle. We define 

j O2 ij)(«3 ij-l) • • • (h k+2) , if J = 2/ is even, 

(11) 9t ■= < 

[(*2 »j)(«3 ij-i) • • • W+i ^+2) , if j = 2/ + 1 is odd. 

Thus, g T is an involution such that r" 1 = g T rg T . 

We choose 51 := id, g 2 := gA u , see (HU), 54 := 5253 and 



k^j l<h<rij 

l<h<n k h^l 



Then a r 



9rcrg r 
9i vi, 

0"25l =91 <72, 
0"35l =91 <73, 

&i9l =91 °~4: 
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, r = 1, 2, 3, 4, and we have the following relations 
0-152 = 92 02, 0-153 = 53 0-3, aig 4 = 54 04, 

02#2 =92 Ol, O-253 =53 0"4, O254 =94 O3, 

0-352 =52 O-4, CJ353 =53 £71, CT354 =54 a 2 , 

0-452 =52 0-3, CJ453 =53 a 2 , (74:94 = 94 01 . 



It is not difficult to see that W := C-span{5iv,52f ,53V ,54^} is a braided 
vector subspace of diagonal type of M(O a ,p), with braiding matrix 



Q 



-1 


2*i j 
-1 


-2ti, 
-1 


-1 


-1 


—2tij 


2ti j 



-1 \ 



w. 



-2/ 



'■j 



2/ 



W, 



Ij 



4*i 

J j 



Since u>„- ' J 7^ 1 the generalized Dynkin diagram is of the form given by 

□ 



Figure [H Therefore, dimQ3(C CT ,p) = 00, by Lemma E 

-1 




Figure 1. 



Remark 3.2. The previous Lemma implies that if dim *B{O a ,p) < 00, with 
p G S£j, then the scalars q e and (fo given in Remark 12.31 must be q = 1 and 



g e = — 1; moreover, t-j = 0, for all j odd. 

Our next result discards the appearance of cycles of length j > 4, where 
j is a power of 2. The proof is an application of the technique of transversal 
abelian subspaces. We also need Lemma I3TT1 

Proposition 3.3. Let a 6 S m , O the conjugacy class of a and p £ S^n- If 
the type of a is (l™ 1 , 2 n2 ,4 n4 ,8™ 8 , . . . , (2 k ) n 2" ,a ), with k > 3 and n 2 k > 1, 
then dim 33(0, p) = 00. 

Proof. We may assume that a is of type (2 n2 , 4 n4 , 8 ns , . . . , (2 fc ) n 2 fe ) , by [XZl 
Prop. 2.6]. If ^o-o- 7^ —1 or if n 2 fe > 3, then the result follows from Lemma 



POINTED HOPF ALGEBRAS: SYMMETRIC GROUPS 7 

12.11 and [AF2j Ex. 3.10], respectively. Assume that q aa = —1 and n 2 k < 2. 
We consider two cases. 

(I) Assume that n 2 k = 1. Let a = {i\ i 2 • • • i 2 t) be the 2 fc -cycle appearing 
in the decomposition of a as product of disjoint cycles, and we call 

I := (h hi§ • • • *2*-l) an d ¥ := {i 2 iii§ ■ ■ ■ i 2 k). 

In the proof of |AF2[ Lemma 2.11], it was shown that 

(a) I and P are disjoint 2 -cycles, 

(b) a 2 = IP, 

(c) ala" 1 = P, (hence ala^ 1 = P), 

(d) P* aP* = a 2t+1 , for all integer t. 

For every I G Z4, we call ai = P 2 l aP~ 2 l and we define as in |AF2} 

(2.17)], 

(12) a r .= P 2k ' 3l aP- 2k ' H . 

Then (o"/)^ e z 4 is of type V4 in the sense of |AF2l Def. 2.2]. 

Claim 1. (i) a 2 = a 2 +l , (ii) 03 = a 2 +1 . 



Proof. Notice that P 2 is an involution, since P is a 2 k 1 -cycle. Then 

a 2 = p2 fe - 3 2 a p-2'=-3 2 = p2fc -2 ap2fe -2 = a 22^+l = p-l+l t by ( d ) 

above. Analogously, 

a 3 = P 2fe " 33 aP- 2fc " 33 = P 2fc - 3 p 2fe ~ 2 aP- 2fc - 2 p- 2fc - 3 

= p 2fe ~ 3 a 2fc_1+1 p~ 2fc ~ 3 = (p 2fc ~ 3 a p-2 t_3 |2^ 1+1 = a 2fc_1+1 

as desired. □ 

Notice that (i) implies that a 2 = a 2 +1 because a 2 = a 2 . Analo- 
gously, 0-3 = a\ +1 . If we define 77 := crT" 1 , for all I, then (ai)i e z 4 U (rz)/ e z 4 

(2) 
is of type V\ . We define g := (i\ i 2 k)(i 2 i 2 fc -i) " " " (*2 fc - 1 -i *2 fc-1 +i)- Then 

g is an involution in S m such that g> a = a~ 1 . We define g\ := P 2 l and 

hi ■■= gig, I e Z 4 . 

Clearly, /i; a = 77, / G Z4. 

Claim 2. VKe se£ r := 2 fc ~ 3 . J^e /zawe t/ie following multiplication tables: 
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90 


9\ 


92 


93 


O"0 


goo- 


2r 

93 °u 


92^2 


— 2r 

gio-a 


0"1 


— 1r 

g 2 aa 


9i & 


2r 

9o va 


93 °2 


0"2 


go<?2 


9s <?a~ 2r 


92 o- 


9i oa 2r 


0"3 


It 

92 era" 7 


9i 0-2 


go aa~ 2r 


53 0" 


TO 


ffoo-" 1 


5-3 a~ l a 2r 


92 o-' 1 


— 1 — 2r 


T\ 


g 2 a~ 1 a- 2r 


91 V 1 


— 1 2r 

go a l a zr 


53 o~ 2 l 


T2 


goer' 1 


— 1 — 2r 

g 3 a l a 


92 o-' 1 


gi a~ 1 a 2r 


n 


g 2 cr- 1 a 2r 


9i°2 l 


— 1 — 2r 

50 0" a 


53 o-" 1 





h 


hi 


h 2 


h 3 


o"o 


hoc?- 1 


h^a- 1 a- 2T 


h 2 cr 2 1 


hi a- l a 2r 


0"1 


h 2 a~ 1 a 2r 


h ± a^ 1 


h cr~ 1 a~ 2r 


h 3 a 2 l 


0"2 


hoa~ 


h 3 a~ x a 2r 


h 2 a~ 1 


hi a~ Y a- 2r 


0-3 


h 2 a- 1 a~ 2r 


h\ a 2 


hoa~ l a 2r 


h 3 a~ x 


70 


ho a 


h 3 aa~ 2r 


h 2 (T2 


h\ a a 2r 


Tl 


h 2 aa 2r 


hi a 


ho (J oT 2r 


h 3 a 2 


7"2 


hoo-2 


h 3 a a 2r 


h 2 a 


hi a a~ 2r 


T3 


/t2<7 a~ 2r 


hi a 2 


ho a a 2r 


h 3 a 



Proof. The multiplications Uigj follow by straightforward computations, us- 
ing the fact that a = a . For the multiplications cij/ij, use that 

h~>j a ihj — (5 i >i°'i5i)~ 1 5 an d the result follows. The rest can be checked in 
an analogous way. Notice that g~,jTigj = (h^jTihj)" 1 . □ 



Our assumption q a 



we have that p(a) 



t. 



= —1 implies that p{cr 2 ) = —Id. On the other hand, 
, , and, by Lemma 13. 11 we can suppose that 



(13) 

Hence, p(aa 2r ) = - 
CGD. Also, p(o-a~ 2r 



t 2 k — 

2rt 



ik~2 



-.fc-1 



or 3 • 2 K 



k-2 



u 2k 2k Id 

!rf 2 fc Id = -i _f 2fe Id = ±Id. Moreover 



1, because of 



-i t 2 k Id = ±Id, with i 

-2rt„ k r 

- -to, 

p(aa 2r ) = p(aa~ 2r ) = -XU, 

with A := fa. Thus, p{a~ 1 a 2r ) = p{o-- l a- 2r ) = -Aid. 

Let v, w € V — 0. We define W := C-span of {ui, v\ \ I € Z4}, where 

ui := gov + g 2 v, wi := h w + h 2 w, 

U2 ■= gov - 92V, w 2 := how - h 2 w, 

U3-=giV + 93V, w 3 := h ± w + h 3 w, 

Ui := giv — g 3 v, w^ := h\w — h 3 w. 



(14) 
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By straightforward computations, we can see that W is a braided vector 
subspace of M(O a , p) of Cartan type with matrix of coefficients given by 



where Q 




and Dynkin diagram given by 



(- 1 - 1 


-A 


A\ 


-1 -1 


-A 


A 


-A A 


-1 


-1 


\-A A 


-1 


-V 



(15) 





Figure 2. 

which is not of finite type. Therefore, dim <B(0 CT ,p) = oo. 

(II) Assume that n 2 k = 2. Let A 12 k = (iii^--- i 2 k) and A 2 2 k = 
fe fc +i*2 fc +2 ••' ^2 fc +0 f ne two 2 fc -cycles appearing in a, and let I = I1I2 
and P = P1P2, with 



Pi := («2«4 • •• « 2 fe )> 



I 2 
P 2 



(i 



2 k +1 l 2 k +3 • ■ ■ «2 fc +!-l 



)• 



Uofc. 



^9fe_ 



■2 '2 



Z 2 fe+l, 



Now, we take 07 as in (|12p and we proceed in an analogous way as in (I). □ 

We next examine the possible p's when the type of a is 

(16) (2 n2 ,4 n4 ), with n 2 < 5 and n 4 < 2. 

Our first result for this question follows by performing the argument given 
in [ATT1 Th. 4]. 

Proposition 3.4. Let a € S m , O the conjugacy class of a of type (2 n2 ,4 n4 ) 
and p E S^. If degp > 1, then dim<B(0,/j) = 00. □ 

The next proposition is proved by the technique of non-abelian subracks. 

Proposition 3.5. Let a G S m of type (2 n2 ,4 2 ), O the conjugacy class of a 
and p S §£j, with deg(p) = 1. //dim 25(0, p) < 00, then p^ = X(i,i) ® s S n or 
X(-i,-i) ® s g n > where i = */-L. 
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Proof. We assume that q aa = — 1, by Lemma 12.11 Since deg(p) = 1, 
deg(p2) = deg{pi) = 1. Let A 1A = (j y j 2 j 3 3a) and A 2 a = (j5 k 37 is) 
the two 4-cycles that appear in the decomposition of a as product of dis- 
joint cycles. We write A4 = A\ A A 2A . Since degp = 1 we have that 
p(A 1A ) = p(A 2A ) = uj\ 4 , with < U < 3 - see Remark El Then 
Pa = Xt H U\ ® M4) with U4 = e 6 sgn, i. e. the trivial or sign representation 
of Z2. Then p(A^) = ±1. We consider two cases. 

CASE (I): q Ai = 1. Then p(A 1A ) = p(A 2A ) = 16-1. We define 
Si := Ai, Sq := A\ A A 2A , t\ := A 14 A 2A , t$ := s x , 

S2 := ^1,4 (k k k 37), s 3 := A XA (j 5 j 7 j 6 j s ), 

sa ■■= Aia {k k k k), s 5 := Aia {k k k k), 

h ■= (ii 3a k h){k k k k), h-= (ii 3 a k k){k k k is), 

tA ■= (71 3 a k h){k k k k), k-= (ii 3 a k k){k k k k)- 

Let a = as^[ and we define Oj := s^a, Tj = tja, 1 < j < 6. It is easy to 
see that (a, r) is of type D^ 2) - see |AF2} Section 4]. Now, t\ = A~{\A 2A a = 
aA^I, a<a = Ai^A^a = crA^I- We choose g := (1 2)(3 4); then gcxii = t\, 
g~ l (Tig = t\ = crA^ y g~ 1 a 6 g = g~ 1 A 1A A 2 ~ A ga = A^A^a = asf 2 . This 
implies that p(n) = p{g~ l aig) = -p(A^ 2 A ) = -1, p(a 6 ) = -p{A^ 2 A ) = -1 
y p{g~ l °~69) — ~p( s i ) = — 1- Thus, we are in the situation of |AF2l Th. 
4.11], and dim 93(0, p) = 00. 

CASE (II): q Ai = -1. Then p{A 1A ) = p{A 2A ) = i 6 -i, where i = >/=T. 
Let P4 = e. We define s\ := A4, 

S2 := (ii k 3a k)(J5 k is k), s 3 -.= (ji j 3 j 2 ji)(k k k k), 

s 4 := S2 1 , s 5 := sj 1 , s 6 := sj" 1 , *i := (ji j 6 j 3 j 8 )(j 2 k 3a k), 

h ■= 0"l J6 J4 J7)(j2 js 33 J5), *3 •'= (jl 31 32 Js)(i3 J6 J4 js), 

t^ := t^" , ts := i^" y tg := t\ ■ Notice that £1 = Ai A A 2A Bi A , where 
B := (ji 3 5) {32 je)(J3 37) (J a is)- 

Let a = as^ and we define o~j := Sja, Tj = tja, 1 < j < 6. It is 
easy to see that (a,r) is of type D^. Now, n = A\ A A 2A B\ A a = aBi A , 
o"6 = c^4j . We choose 5 := (2 6)(48); then g > a\ = n, g~ x o\g = ri and 
5 -1 o-65 = 5" 1 ^i^4 j4 2^4fi , a = cr^J 2 ^^. Then p(n) = p{g~ x aig) = p(a 6 ) = 
p{g~ l <?%g) = -1, and dim 93(0, p) = 00, again by [AT2l Th. 4.11]. □ 

Our next task is to discard the type (2 2 ,4 2 ,<7 D ); we do this by the tech- 
nique of transversal diagonal braided subspaces. 
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Proposition 3.6. Let a G S m of type (2 2 ,4 2 , a ), O the conjugacy class of 
a and p G S^, with deg(p) = 1. Then dim 25(0, p) = oo. 

Proof. By |AZt Prop. 2.6], we may assume that a G §12 is of type (2 2 ,4 2 ). 
If y»4 7^ X(i,i) ® s § n ) X(-i-i) ® s g n ) where i = \J — 1, then the result follows 
by Proposition 13.51 Assume that /3 4 = X(j,i) ® s S n or X(-i,-i) ® s g n i with 
i = v— T. Following the notation given in the preliminaries, we take A\^ 2 = 
(1 2), A 2)2 = (3 4), B lj2 = (1 3) (2 4), A lA = (567 8), A 2A = (9 10 11 12), 
B 1A = (5 9)(6 10)(7 11)(8 12). We call A 2 = A h2 A 2j2 , A A = A 1A A 2A and 
o- = A 2 A A = (1 2)(3 4)(5 6 7 8)(9 10 11 12). We define <j := a, a x := 
(1 2) (3 4) (5 9 7 11) (6 12 8 10), a 2 := a^\ a 3 := a^ 1 , 

r := (1 3)(2 4)(5 6 7 8)(9 10 11 12), n := (1 3)(2 4)(5 9 7 11) (6 12 8 10), 

r 2 := Tq 1 and r 3 := rf 1 . It is easy to see that the family ((Ti)i e z 4 U (n)i eId4 
is of type vf\ We choose g := id, 5i := (6 9)(8 11)(10 12), # 2 := 
(6 8)(10 12), g 3 := (6 11) (8 9)(10 12) and hi := (2 3)^, Z G Z 4 . 

Let v, w G V — 0. We define W := C-span of {ui,vi \ I G Z4}, where u;, vi, 
are given by (fl4l) . The condition q aa = — 1, implies that p(A 2 ) = p 2 (A 2 ) = 1, 
because /04 = X(«,«)®sgn or X(-j,-j)®sgn. This implies that p 2 = Xfofo)® V2) 
with ^2 = or 1, and p 2 = e or sgn. We consider two cases. 

(a) p 2 = X(t 2 ,t 2 ) ® e - By straightforward computations, we can see that 
W is a braided vector subspace of M(O a ,p) of Cartan type with matrix of 
coefficients given by 



where Q 



and Dynkin diagram given by (fl5]) . and dimQ3(0 CT ,p) = 00. 

(b) p 2 = X(t 2 ,t 2 ) ® s S n - We proceed in an analogous way. □ 

Our next goal is to discard types with 714 > and non-trivial a . The 
proof relies on the technique of the octahedral rack |AF2l Section 4]. 

Proposition 3.7. Let a G S m of type (l™ 1 , 2 n2 ,4" 4 ,cr ), with n 4 > and 
a ^ id, O the conjugacy class of a and p G S^. Then dim 25(0, p) = 00. 

Proof. We assume that q aa = —1, by Lemma [2.11 Hence q e = — 1 and q = 1 
- see Remark 13.21 Notice that q e = qA 2 QA 4 - We consider two cases. 

(I) Assume that n A = 1. Let A\ A = (ji j 2 j'3 j'4) the 4-cycle appearing 
in the decomposition of a as product of disjoint cycles. We call s\ = -Ai 4, 




/-I 


-1 


-1 


1\ 


-1 


-1 


-1 


1 


1 


-1 


-1 


-1 


vi 


-1 


-1 


-1/ 
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S2 = (ji h k h), s 3 = (ji j 3 j 2 h), sa = s^ 1 and s 5 = sj 1 , s 6 = s] -1 . Now, 
we define 07 := AiA 2 sia , 77 := Ai^-SiO"" 1 1 < / < 6. Then the family 
fa,Ti)i<i< 6 is of type D( 2 ) - see dEH Def. 4.7]. 

We choose g := J| fc odd gA k - see (fTTj) , Thus, g is an involution in S m such 
that go^g = o~~ l ; then gcrg = T\. Now, we compute 

p(g~ l (Jig) = p(ri) = p^i^sicr" 1 ) = p( J 4 2 ^4)p(o- )" 1 = <?e<7oId = -Id, 

p(a G ) = p(A 1 A 2 A^ 1 a ) = p((A 2 A 4 y 1 )p(a ) = q^ l q ld = -Id, 
P(^V 65 ) = P {A l A 2 Al 1 a- X ) = p((A 2 A 4 y 1 )p(a; 1 ) = q^q^ld = -Id. 

Then dim 93(0, p) = 00, by [AF2l Th. 4.11]. 

(II) Assume that n 4 = 2. Let Ai )4 = (ii j 2 J3 J4) and A 2A = (j 5 j 6 j 7 j 8 ) 
the two 4-cycles appearing in the decomposition of a. Now, we proceed 
as in the previous case with si = A 1A A 2A , s 2 = (ji j 2 j 4 j 3 )(j5 J6 is J7), 

«3 = (j'l J3 32 H)(J5 31 k is), S 4 = S^ 1 , S 5 = Sj 1 and S 6 = Sj" 1 . □ 

We finally discard most of the representations p\ entering in p, see ([5]). 
We apply the technique of P3, see |AF2} Section 3], to the first proposition, 
and the the technique of the octahedron, see [AF21 Section 4], to the second 
proposition. 

Proposition 3.8. Let a £ S m of type (l ni , 2" 2 ,4 n4 ,cr ), with n 2 > 0, the 
conjugacy class of a and p £ S^. If degpi > 1, then dim 93(0,/)) = 00. 

Proof. We assume that q aa = —1, by Lemma l2.1i Since degpi > 1 we have 
that n\ > 0; actually n\ > 3. Let A\ j2 = (j\ j 2 ) be a transposition appearing 
in a. There exists a j'3 such that a fixes j'3 because n\ > 0. We define 
0-1 := a, cr 2 := (ii i 3 )(ii i 2 )o- and a 3 := (j 2 j 3 )(j'i j 2 )o". We choose 51 = id, 
ff2 = (j2 J3) and 53 = (ji j'3). Let v, w be two linearly independent vectors 
in Vi, the vector space affording p\. We define W :=span of {giv,giw | 1 < 
I < 3}. Then VK is a braided vector subspace of M(0 CT ,p) isomorphic to 
M(0f,sgn) ffi M(0f,sgn), and dim«8(W) = 00 - see [ATTSl Th. 4.8] or 
[AF2l Th. 2.1]. Therefore, dim 53(0, p) = 00. D 

Proposition 3.9. Let a £ S m 0/ type (l ni , 2" 2 ,4 n4 ,cr ), mtfi n 4 > 0, i/ie 
conjugacy class of a and p £ S° n . If degpi > 1, i/ien dim 93(0, p) = 00. 

Proof. We assume that Qo-o- = —1, by Lemma 12. 11 Analogously to the previ- 
ous result, we can construct a braided vector subspace of M(O a ,p) isomor- 
phic to M(0|,x(_i)) © M(0|,x ( -i)). Then dim 93(0, p) = 00, by [AHS| 
Th. 4.7]. □ 
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Our final reduction is about the characters in cases (iii) and (iv) of the 

(2) 

main Theorem. We apply the technique of the rack T>\ . 

Proposition 3.10. Let a £ 8 m of type (l ni ,2 n °-), with m > 0, O the 
conjugacy class of a and p £ §£i ■ U 

(i) n 2 = 3 and p 2 = X(3) ® e> or 

(ii) n 2 = 5 and p 2 = X(5) ® e or X( 5 ) ® sgn, 
i/ien dim!B(0,p) = oo. 

Proof (i) Wesetcr= (12)(34)(56) and define a :=a,aj := (1 2)(34)(5 7), 
o"2 '■= o~o > 0"i; t~q := (13)(2 4)(5 6), T\ := a 2 > To and t 2 := o"i > To- Then 
(o-j,Tj)jzz 3 is a family of type P3 in Og-. We choose g = (2 3). Thus, 
p{g~ 1 o-g) = p(tq) = p 2 (^.3,2-61,2) Id = —1, see Subsection 12.21 Therefore, 
dim«B(C,p) = 00, by [JF2l Th. 3.7]. 

(ii) We take a = (1 2)(3 4)(5 6)(7 8)(9 10) and define a := a, a x := 
(12)(34)(56)(78)(911), a 2 := a ><n, 

T Q : :=(13) (2 4) (5 7) (6 8) (9 10), 

r\ := a 2 \>TQ and t 2 := ai>TQ. Then (aj,Tj)j € z 3 is a family of type V3 in C CT . 
We choose g = (2 3) (6 7). Thus, p(g- l ag) = p(r ) = p 2 (A 5 , 2 B 1:2 B 3 , 2 ) Id = 
-1, see Subsection E3 Hence, dim 05(0, p) = 00, by [%F2l Th. 3.7]. □ 
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